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This invention concerns a product which has at 
least one writing surface which is provided with a posi- 
tien cods, which codes several positions on che snrface, 
uo enable electronic recording of. information v/nich is 
written on zhe writing surface, using a device which 
detects the position code. The invention also concerns 
■a device, a system, a coinputer prograni and a method for 
processing .i nf ornac ion . The invent ioii also concerns a 
hand-held electronic device which is arranged to carry 
out predeternnlned cperations at ;;.he crGrnniand. of a n^^^er. 
The invention also concerns a papei; prcdncu and a digital 
storage medium. 

Many people nse paper and pen instead of corrputers 
to write snort messages, in particular notes from tele- 
phone calls and meetings. The reason can, for example, 
be that chere is no computer available, that both hands 
are needed to enter text efficiently via a computer's 
keyboard, or that it takes a long time to start up the 
right program in the computer. Even if notes are written 
tn paper, people vrill often v..-arjt to enter selected parte 
of them into a coTTspnter, for example a note concerning 
a meeting into a digital calertdar or an address into a 
digital address book. 

In dS 5,852,434 a device is shown which ma:-;e:=j it 
possible for a user to enter handwritten and hand-drawn 
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inf crtT:;-aM05n inro a cornp-uter at the .3arne tir;e as th--? 
information is written or drawn on a writing surface. 
The device comprises a writing surface, on which a posi- 
tion .code which codes. X-Y co-ordinates- is arranged, and 
a spec.^.a.l pen with a writing tip.- v/hicl-- the asar can uive 
for \-vritiri-9 or drawing cn the writ.:.ng aurrace. The pen 
baa also a light source for iilm-iinat ing the position 
coda and a CCD sensor for receiving the light which is 
reflected from the position code. The position informa- 
tion received by the CCD sensor is sent to a cosnputer for 
processing. This device appears to require a computer to 
be started up and a certain program to be opened before 
the writing on the writing surface can begin. 
.Summary olJPiie jnyention 

An object of this invention is to further simpiify 
the processing of handwritten inf orniatiOTi. 

This object is achieved cosnpletely or partially by 
a product according to claire 1, a p-aper pro-iuct according 
to claisT; 7, a device according to clairrs 10, a coiaputer 
prograin according to claim 19, a storage medium accord- 
.ir.g to- oiai;a ;n;, a s-ysteft according to claira 21, a ;-!-:ethcd 
according to claim 23 and a hand-held electronic device 
s c c o .r d i n-g c o o 1 a :l ra 2 4 , 

More specifically, accordin9 to a first aspect, the 
Invention concerns a product which has at least one writ- 
ing surface which is provided with a position codOf vdiich 
codes s-i^veral positions on the surface to enable electro- 



nic recording of iafarination which is written on the 
v/rit. ing iv^urface by rieaiiK or a device. v;h:-ch d-Dt&cts the 
position code. The product has also at least one activa- 
tion icon which, when detect ad by the device, causes the 
device to ini t laLc a predetermined operation vd-iich uti- 
lises the information recorded by the device. 

Thus, Che product has not only a v/iiLmg surface bu;;. 
also an activation icon, by means of which the user can. 
ooET^saand the de'/ice fo procesi^ the rec--.-^rded ir;.ih-ir:!iat ion in 
a predeterfnined way. As a result of this, the user does 
no:: need to press .heys or buttons on the device itself 
but instead he uses the activatioin icon on the product 
as a iTieans for controlling- the device. The activation 
icon can be likened to an icon on a coftputer screen, 
hut in:?v.ead of placing the screen cursor cvn the icon and 
clicking by neans or a rnou:.^e, t.he user n:OV; sneers a coiru 
snand by placing the device so that it can detect the 
activation icon on the product. The product thus consti- 
tutes a new type of user interface for the processing of 
information which, is written on a writing surface. 

The activation icon can be in the forra of an image, 
a syt'boi, text, nurbers or the like, enabling a user to 
understand and reniernber which operation is initiated when 
he uses the icon. The detection of the icon by means of 
the device c-irn be based on th.e above characteristics 
which the user utiliKes to interpret the meaning of the 
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icon or other characceristics, ^?uch -is t^Otrie lorra of: code 
v/r.ich r/iie device detects. 

The v,.-ritten i?- ;;or;Tia t .1 on which i .^i recorded is here 
any kind of information which can be created by hand, 
such as cext, nu-hcers, various types oi characterc, 
f 1 g u r e s i;-: rid draw .i ug s? . 

As mentioned above, the product has thus at least 
orie activation icon. In a pxef erred eirsbodirner-t , hcv;ever,. 
the product l^as a nusnber of activation icons for activat- 
ing various predetermined operations. The user can thus 
choose between different operations which utilize the 
recorded information. 

The iccn and the position code can be deci3r:&d in 
many different i^ays , For exaTtiple, chey can be electri- 
cally, chernically or mechanically detectable. They need 
not ts detectable using the. same principle. However,, in 
a preferred embodiment both che icon and the position 
code are optically detectable. In thi^^ way they are easy 
to apply to a product, as they can, for example, be 
printed on it, and .in addition a device with one or more 
optical sensors can be used for detecting the icon and 
the position code. In this eitbodiment: the activation icon 
and the position code are passive. They only need to he 
eatable cf reflecting light. Hov.^e.ver, the light need net 
foe iI^ the visible range. 

i.n principle, the activation icon can activate t;-;e 
device to initiiite any conceivable operation v;hich uti- 
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lizes the recorded information. The choice is realiy only 
Xin:!ited by the fuxictions Gi the device which is to uti- 
.1 i ze Lh-^ produce. There c?.n be a standard sec of icons 
on the p.codncr. . It is not necessary ior all device.^ to 
be able ::.c n.re all chs scciva u iorj icons. In a preferred 
embodiment the predeterrained operation is an operation 
from che following group : dialing a telephone nuniber 
whi.ch ia part of the information, sending a fax with text 
which is part of the information, sending an electronic 
message with text which is part of the information, writ- 
ing ari addrest; v/hich is part of the inf or;m\t ion in an 
electronic address book/ entering calendar information 
v^ihich is part of the inf orsrsation in an electronic calen- 
dar and entering a task in an electronic list. 

The position code can be oi various types. Examples 
of kno:wn position codes which code each position uith one 
syrrODol or a group of symbols can be found in the. above- 
mentioned US 5,852/434 and in US 5,051/736, The position 
code can preferably be of a type which codes each posi- 
tion v,?ith several syribols,. v/nere each Gymbol concributes 
to the coding of more than one position. Examples of how 
•cht,s typ". of overlapping or floating cede can be imple- 
iisented and detected: can be found in the Applicant ha pre- 
vious Application No. SE 9901954-5, which was filed on 

May I?99 and v.liich is ineorpo rated m the present 
applicatior: by oeans of this reference. The advantage of 
this position code is that ir, provides good resol. nv.ion. 
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and is easy to detect since the indrvidual symbols are 
HOC corsiplex. 

The prod'uct can be any prGd-.;ct. v^hich has .a wriv.. ina 
surface and at least;, one activation icon. It can be coni-- 
posed o.f two physical parts, the writing surface with the 
position co,de being locat.ed on one of the parts and the 
activation icon on the other. Alternatively, it can con- 
sist of a single part incorporating both the activation 
icon and the wrxting surface. In this case the activation 
icon can be located on the writing surface or on some 
other surface. The produce can, for example, be a sheet 
of paper with a position code on one part of the sheet 
and an activation icon on another part of the sheec , In 
a preferred eTribodiment , the product is a notepad with 
several writing surfaces. 

In addition, according to a eecond aspect, the 
invention concerns a paper product consisting of at least 
one sheet, vdiere af: least part of the surface of the 
sheer, is coated vyith. a preferably v.'eakly adheoive l::r/er 
and where the sheet has a writing surface. According to 
this aspect the- inventron is characterized in that the 
writing surface is provided with a position code which 
codes a nuciber of positions on the writing surface to 
enable electronic recording of information which, is writ- 
ten on the writing surface,- by neans of a devioe which 
detects the position code. The paper product con-prises In 
addioion at least Oiue activation icon which, when it -s 



de-r:eci:--3d by the device, causes vJue device to initioice a 
predetermined operation which utilizes the informatiGn 
i-ecoi-ded r.vy the device. 

The writing surface and the adhesive layer are pre- 
ferabiy iocav.ed or; opposite sides- or the sheet. Tiie pro- 
duet preferably cofsprises a number :of essentially iden- 
tical sneetc. Advantsge.s and further variations of the 
paper prcducv.. are apparent frorri the above disousUTion . 

According to a third aspect, the invention also con- 
cerns^ a device for processing inf ormat ion, which device 
itv. arranged to record and process? information eleccro- 
nicaily. The device is also arranged to initiate a pre- 
dete,rn-:ined operation, v.;hich utilizes the electronically 
recorded into.r:t-;aticn, wiien it decects a predeterniined 
accivcition icoxi. 

An advantage of this device is that it is easy to 
u,-^;e,, a.« the user doe.^= not have to iearn any con-!rnand.vi or 
pr&sa any buttoriS to open a desired program. 

As nientioncd above, the device -a-III at least ini- 
tiate f.hte predeterrrsined operation vdien the icon ia 
detected. Depending upon the functions of the device, 
it n:ay in certain cases carry out the entire ope r cation. 
In other eases the device can, for e:K:arRple, automatically 
transfer the recorded information and inf orination abouf 
which operation is to be carried out to an external unit, 
for exan-iple a PC or a ftobiie telep"i^one, which completes 
C-he operiiticn. The transfer can take place in;rr,ediateiy 
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or at a later Li;r;w, By "initia'ce" is raeanL here tha-:. the 
dev. ice ensi-res that the cperar. ion is carried out, ever;, .if: 
it does not carry out. the operation itself, so that the 
user does not need to give further GOTiusarids to the device 
or the exrernel unit in crder fo.r t.he c.peration to be 
ca.vried ouu . Ho'^ever, the user :nay need to supply addl-- 
t i onal i n .t or^ia t i on and/or cor: f i rirs t he ope .-.-a t i or: / 1 n .r o;:.'n ia - 
tion.. 

The device can record information in different ways. 
It can comprise a sensor, for example an acceleroiiieEer , 
'vhnich records t.he nioveraent of t.he device when the device 
is being used for writing on a writing surface. It can 
also comprise a scanner, which scans the information. 
However , .ion a preferred ernbodiaient , the device is arrang- 
ed to record the information by detecting a position: code 
located on a writing surface on which the informatlGn is 
written by hand. This embodirsient is advantageous as the 
iniorn-ation is recorded at the sarae tiirse ae it is being 
Vvritten and r.he same sensor can be used for recording 
the written information and for detecting the activation 
icon. In this eiTsbodirEent the position code is continuous- 
ly detected while the inf or-nae iou: is being vnritten, v.Mth 
a 8eqi..<ence of pcsition indi ea":,ions being obtained v^oich 
defines how th=e dev.rce has teen nxcved . 

As indicated, abo-ve, the device cmi use different 
types of sensors depending on the technology need to 
implernene che posicion code and the acr. ivaticn icon. In 
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a preferred erabodivaent , the device coraprises ar. optical 
sensor to detecc the activatior: icon, "n addition the. 
device advantaceous:. y comprises a;.i cp.tical seneor which 
is arranged to record images of the: writing surface and 
a ;i;i-:?nal processor v;hich is arranged to utilise the posi- 
tion code ir:x tie irsiagea to create a digital re or e sex; t a- 
tion of the information ^ the predetermined Qperation 
beijiq carried cui: on the digital representation of the 
information. The optical sensors: are advantageons in that 
they enable the inf orrf\acion recording and the initiation 
of Lhe predecer;nin:ed operation to be cased on i;rage prc- 
cessingj which is a well-known and tvell -developed techno- 

Viiniie cne dfev^ice can be inplemented v/ich cv.'o scr^^vors 
of the same or different types, the device will be less 
e:xpensive and easier to use if ic is iiTsplemented with a 
s.ingle sensor roi- recording inforrnation and else for 
detecting the activation icon. 

According to a fourth aspect: of this inventiC'n, it 
ocnoerns a cot-.puter program for processing infcrruatlon 

"•v ■=■ V. ci: 't : _ ^ ► ' by 

corrsptiter and which coKsprises inscruct:ions for causing the 
oon^puter to detect an accivation icon in an image and to 
initiate a predec erniined cperation in response to the 
dev.ecc.ion ct che activation icon. The advantages of this 
p.rcgraTr; are apparent from the above discussion. 
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A.ccordiiig to a fiftli aspect: of t.hi::; inventio-n, it 
concerns a storage medium for digital inf orniation which 
can toe read by a computer system, which, storage medium 
contains a computer program for processing information. 
This comprises instructions for the following steps: 
detection of an activation icon on a position-coded 
sheet; detection of a graphical input on the street; and 
reproduction of the graphical input in a program wi.ndow 
in an application in a computer system where the appli- 
cation is associated with the activation ic:on. 

S;.uth a program makes pcs^sible uncomplic-ujed record- 
ing of information connected to a particular application 
which is running on a compnter system. example j a 

paper produce as described above oan be provided with a 
"to do" icosiv If a note is made concerning a task which 
is to be carried out, usif-g a device of the type describ- 
ed above,, on toe vvr i .-i.ng surface o.C such a taper product 
and then the "to do" icon is marked, the handwritten note 
can be reproduced in a "to do" function in, for example, 
a calendar program. The task will not then be easily for- 
gotten . 

According to a sixth aspect of this invention, ic 
ooiicori'is a system: tor processing inf orm^-at ion comprising 
a product provided v,m,th at least one aotivai: ion icon 
which indicates a predetermined operation, and also a 
ievioe which is arranged to record ohe information eleo- 
tronioally and which is arranged to initiate the pre- 
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decerrnined operaiMon vvi--.h respect v.o the recorded lni;.or- 
mation when it detects the aetitration icon. 

The advantages of this syscem are apparent .fro-n the 
above discussion . 

According to a seventh aspect of the invent.ioii, it 
concerns a method of processing inforariac.i.or;., coniprisinq 
the seeps of writing the information on a writing surface 
with a pen; recording the written inforination electro- 
cically by inearis of ;u device ; and ca-i^sing rihe device oo 
initiate a predetermined operation with respect to the 
recorded inforTnation by causing the device to detect an 
activation icon. 

This method enables the user to process information 
in a very simple wfay . He can write down iiirorrfiatxon a© 
usual on a sheet of paper with a device comprising a pen 
and stiil irrvmediately initiate one or more operations 
■which normally require a special coirtputer program to be 
started and subsequently information to be inpnt into a 
Gcnipucer, simply foy causing the device to detect an acti- 
vation icon. According to the inventiQn it is not neces- 
sary to A-i'-ite do\vri the information prior to the detection 
of the activation icon. It is also possible to cause the 
device to detect the activation icon prior to writing the 
note. 

The ^echnoiogy described above couid also oe used 
fox general control of hand ■■held computers -^nd other 
hand -held electroij.ic devices, such a mobile teiephonec, 



PDAs., reading pens and hand-held scanners. The. Vise.r cca- 
i-.rolB 8uch devices hy se.lectirig, by r;-eans of one or a fev; 
buttons, from menus or icons shown on the computer dis- 
play. Thes:-e devices could be cont:rol.l.ed .-...n an eas.ier way 
by utilizing ativ..i vation icons v/nlch activate various pre - 
deterrRineci operations normally iR>pieraente:d by pressing 
buttons , 

For zhls purpose,, according to aiiother aspect, the 
invent xon concerns a hand-held electronic device which, is 
arranged to carry o\5t predecerrained operations on CGmrfiand 
from a -user. The device has an optical sensor for detect- 
ing at least one acti-vation icon, and. a s.:.g.nal processor 
which is arranged to carry out one of said predetermined 
operations when, che optical sensor detects the activation 
icon . 

In particular the device can be a reading pen of the 
type C Pen which is sold by the Applicant. Such a. reading 
pen is described in, for example, SE 9604008-4. This 
dev. Ice is controlled by means of .buttons and menus shovvn 
on a display. The control could be simplified by the use 
of activation icons. 

The .activation Icon or icons ca.n, for exan\ple, .b'C 
located on a product of the mouse-mat type^, on a sheet 
of paper, or on some other product which is easily 
accessible to the user. The predetermined operatiGn can 
be a.ny cperation which a user normally i.astructs a .hand- 
held device to car.ry ont by nLe-ans of a n\ouse , buttons or 
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keys on a keyboard. Examples of ,"uoh operatiC'iis inciuds-: 
starting or closing a program and saving or deleting 
iTVi:cr;ria-;.ion ■Aiiich has been recorded. 

Naturally, twiners applicable ^ the above statements 
coxicerning the device for processing informacion also 
apply here. 

.[i];:i.s-i....;;^.s-s:;;.rip.i;.i.on„ 

The invention will now be described in greater 
detail by -.vay of a preferred eriood.i rnent and vvicn refe- 
rence to the aGCompanying figures, in which 

Pig. 1 shows 3che;Tiat.i.ca.r.'.y an. erabodiroent of a prc- 
duct according to the invention in the form of a notepad. 

Fig. 2 shows schematically an embodifnent o£ a device 
.according to the invention:. 

.Figs 3a a.rLd 3h aho-Af a paper product according to the 
invention . 

ilig. 4a illustrates che operation of a coaipute.r pro- 
gram snored in a storage medium according to the inven- 
oion and Fig. 4b shcva? a flow chart w'nich i 1 lustra". es 
steps corresponding to instruct lon.s in such a program. 
Detailed Descripuicn of a Pr eferre d S;rbodiment 

Fig. :. s.hcws a notepad 1 •vvit.h several sheets 2 
of paper. 'Phe tC'p sheet has a wriring surface 3 and a 
coamiand field 4. 

On the writing- surface. 3 there is printed a posi- 
t.iori code S w.hich i.s composed of symbols 6 of a first 
and a second type 6a, Sb and mere specifically a dot whth 
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a l.-irger radius and a dot viith a s^Tialier radius, cGrre-- 
spond.lng to a ''one'' and a ''zero'" respectively. For v,ha 
sake of clarity the symbols have been enlarged and the 
position code is only shown on a small part of the writ- 
ing surface. In an actual embodiment, the position code 
excerids over tVie entire writing surface and the sx'rnbols 
are aa^aller to ensure better position resolution. 

The position code c-:!n be created ."i.n a nLT-icer of di.t-- 
terevit ways. One way of creating a r.-ositiGn code v;here 
each position is coded by one symbol is described in 
US 5,352/434. However, in the present invention each 
position is advantaQeously coded by means of several 
ayjnbois and tiie coding is such that each syrab^>l ir. the 
position code contributes to the coding of more than one 
poaition. This means that two adjacent positions share 
soine syvfLbola, as indicated in Fig. 1 by the dashed areas 
5a, 50. in udhis v>.'ay a higher resolution is achieved and 
the detection becomes easier, a.s the individual symbols 
can be less coTrplex.. This, t.ype of overlapping or floating 
position code can be created by means of a computer. A 
special -A-ay of generating such a floating position code 
IS described, in the Applicant's previous patent Applica-- 
txon No. 9S01S54-9 which was filed on .28 May 1999 and 
which is .inocrpcrated in the present application by irieans 
of this reierence. 

In the cotmnand field 4 there are printed seven dif- 
ferent activation icons 7a-c- which can be used to command 



a device to .initiate or carry out differoiit ocerations , 
T.he iccnsT 7a~g are griiphicaily designed i!"; s'i.ich a way 
thi5t the user uan understand v;hich operation is aotivav-ed 
by the icon. In this example, the icons coraprise images, 
b'o.t they can also coxopri^e ivexv. and nunbe-rs . 

Fig, 2 shows a device which can be used for writing 
Lexi- and drav/ing figiires on th-^ wrii..ing surface and for 
c-rcryi"g out operations whrcii are iuiLiar.ed by riiie .acti- 
vation rcons. 

Tl;e device coiviprises a casing 1.1 v/hich is approzi - 
mately the same shape as a pen. In the short side of the 
casing there is an opening 12. The short s.ide ic ini. ended 
to be held in contact with or a short distance from the 
writing surface and the command field. 

The casing essentially contains an optics pai"t, an 
electronic circuitry part and a power supply. The optics 
part comprises at least one light -emit, ting diode 13 for 
illuffiinatitig the surface which is to be iiaaged and a 
light-sensitive area sensor 14, such as a CCD or CMOS 
ivensc.r, for recordhng a tv;o-d.i.fr;ensiona.'.. image. The device 
may also conprise a lens system (not shown} . 

The po\ver supply for the device .-..s obtained tro^a a 
bar.te.7.-y 15 w.hich .is -viounted in a separate con-pa rtment in 
the casing. 

The eleorronic ciTcvirry part coinpriees a signal 
processor IS , The signal processor is iiTipleiTsentad by 
^neans of a riiicroprocessor and conr.ains software for 
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a.n?<.ly~inq inages frorii the sensor for creating a digital 
representation of what is being written on the writing 
surface and for detecting che activation icons . In addi- 
tion, it conprlses software for mi tiat ing or carrying 
our the operations Indicated by the activation icons. 
Finally, it: may also comprise user software, such as 
adiress booh soft^A-are to help the user r.c keep track" of 
addreBscty, c-alendar software to help the user keep crack 
of calendar inf orry.ation, suci; as rnestings, birthidays and 
other information, which is entered in a diary or calen- 
dar, and alro ■■■'tc do" liec software so ttiar the user can 
enrer tasks which he is to carry out 

The signal processor also advantageously comprises 
ICR software which can be used for interpreting recorded 
characters so that they can be srored, processed and/or 
t.;;an£f erred in character-coded forniat . 

Finally, the electronic circuitry part also com- 
prises a mobile teiephona unit which comprises a mobile 
v.elepiione vrransceiver 1", which Dakes it possible to 
telephone, send faxes and send e-irsail fnessages lo an 
external unit in the form of a telephone, a fax raachine 
or a computer. 

In addition, on the casing of the device there is a 
pen point :■ 8 , by raeans of whi.ch rhe usei;- can write ordi- 
nary pigment-based writing on the writing surface. The 
pen point IH can be expended and retracted so that the 
user ran control v;hether or nou it is to be used. 



The device also comprises bui.tona? 13 by ir.sans of 
v/hlch r,he user c\5:i activate -And concroi the device for 
operations which, are not controlled by the activation 
iccne. It slso ccM-vpriees a transceiver :;.0 tor >;ire.lesK 
trensfer of 1 rjLLor;-:;ai-,iOii across shorv. distances,, for 
-example using infrared light or radio waves. This wire- 
less transfer can be rised when the device cannot carry 
out the coTRplete initiated operation itself and needs to 
transfer to an external unit the recorded inforTnation and 
information about -if/hich operation is to be carried out. 

Finally, the device comprises a display 21 for show- 
ing, for example, recorded information. 

The Applicants Swedisn patent IMo . 560-=i00S~4 
describes a device for recording text. If programn^ed in 
a &\.iita.tle v/£vy, this device can be used to record bafor- 
•nation whieh is vv-ritten on a writing surface provided 
v/ith a position; code, for detecting activation icone and 
for iniciacing/carrying out operations activated by the 
activation icons < 

The operation of the notepad in Fig. 1 and the 
device in Fig. 2 will be described belov. 

Acsurae that a user receives a telephocie call. He 
vvritss his notes on the notepad 1 using the pen point 18 
of the device. Assuf^^e, for exaa\ple, that the person vino 
telephones wants the user to telephone John on a certain 
telephone number. The user writes "Phone John S857299" on 
the notepad I, 
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feila the user is writing, the optical sensor 14 
continuous iy captures in^ages: of the writing surface 3 in 
Che current position of che pen. The images contain the 
posiinion code 5. The signal procesf^or 16 localises the 
pcwiticn cede in each iraage and,, based on thi3, dev.er- 
ru.i.ries the ccordinaL-es of. r.he. abso'luce position, on t.he 
vN-riticg suriace in ^vhich e-ach image v;as captured. I-l this? 
way a description is obtained, m the form of a large 
number of position indications, of bow the pen Is being 
tiioved across the sheet. This description eonstitut.es ■ a 
digital .r.-ep.resentet ion of u.h:e \vrli.ten inf orr^natlon . The 
position indicatiGns can, if required ^ be fed as an inpiit 
signal to tiie ICR software which determines the oharac- 
tors V. .-.J :vhbt;i line positions correspond,, so r.har. che 
inf orfration can Oe sto.red in character-coded forraat 
instead of as a sequence of position indications. 

l-fnen ivhe ■.■ser has fin.-; shed his telephone converea- 
cien, he places the -device on the top icon -which looks 
like a telephone. When the device detects the telephone 
icon it starts a program for diabing a telephone nii-nber 
by ineans of the mobile telephone transceiver 17. The 
dialing program fetches the numbers of the telephone num- 
ber directly from the -recorded intor-nat ion , The proQra.vr, 
shows the number on the display 21 and waits for the user 
to confiriT! by pressing a b'atton that the nurnlDor is cor- 
.reel-, and r.nat it s.hould actually be dialed, When this 



has beeiL done, the nuird-jer is d:.,aled autoiTiaivical iy and the 
user can speak to John,- 

The detection of the activation icon can be carried 
Gut i.'j v.^^riouiv v/ay3 . For ezan-ple , it can be carried out 
or: the basis of tha same information the user ases to 
determins which icon he should use:, that is rhe image or 
i:.ert conL-,".rac in i-.hv- cofnmand field 4. In another e:'r.a;;-?p,J.e , 
the posiaion code oan extend across the command field, 
Che ioona thuB being superinvposed on iihe posi t .i 0:0 code or 
vice versa. The image of che icon will then also contain 
tr^e pcsition oc-de . As a o^erLajni icon is alway- m a cer- 
tain locationi tiie icon detection can be based on the 
detection, of a certain position. As yet amother aiternc - 
tive, the icon can be provided with another code,, .for 
example a bar code, or sysnbols or other disninccive fea- 
tures which make it possible to identify the activation 
icon. 

Another exair;ple of hov; the notepad and the pen car- 
be used is as follows. The user remembers that he is to 
collect his car fror;: the garage at 4 p.nn He writes a 
note on his notepad, "collect car at. 4 p.m.". This infor- 
!V;ation is recorded it; the pen by n^eans of the position 
code. The user ahen places the pen cr_ the calendar prc- 
gram icon 7e, where-apcn the pen detact.s it and act,i.vates 
the calendar program. The program fetches the recorded 
information. If it is in the fortrs of position indications 
it can., of course, only be stored as position indications 
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in the calendar program. In this case, the program can 
s\;qc:est., i.ha'c the no'ce be entered ur;der today's date and 
ask the user co confirm this by pressing a button on the 
pen. Hov/ever, if the inf or-Tiar ion is in character -coded 
forraa!.-. .. L;.hc progran- can ini-.e-j;preL. ■■p.rtn- as a tin;e i-uii- 
cacion and enr. er uiie none under r-his time and set. an 
alarm. 

Qther activation icons can be lissd in a similar way. 

The fax icon 7b can be used if V-he user v/ishes to 
send a fax. In this case, the user writes his fax raessage 
on i:he v;r.-.ting s\:rf3ce and activates the fax program by 
rnesnr:; of the icon 7h , The fax prograai asks K-here tdie fax 
is t:o be sent, 7'he user c^Jin retrieve this inf Gr-T;av.icn 
from an electronic address book, in the pen or write it 
by hand with the pen on the sheet of paper. The fax pro- 
gran;: then coiTfposes the fax automatically and send,s it via 
the mobile telephone transcei-yer 17 to the intended reci- 
pient - 

E-viail messages can be coocosed and sent in a corre- 
sponding way by activating the e-mail icon 7c , 

Information for an address book or a "to-do" list 
can .be processed In the saiTiC v.;ay as inforiraticn fo.r the 
calendar program, lising the address book icon 7d and the 
"to-dc^ list icon 7f. 

Finally, notes can be deleted from the pen' s memory 
by means of the recycle bin .icon 7g . 
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In another embodiment, the device in Fig. 2 caxi 
be cor ■■-■.rolled by means of ac:. i^-.-'ation .icons vvViich can be 
similar in design to the icons on the notepad in Fig. I, 
but A-hich ■relate to ope'rations S'ach as openlrjg and clos- 
ing p;:ogi;avr;s '3.nd other opery. ■;. ions which the user norraai j.y 
eontrois by jrieans of the buttons 19 on the de'v'"ice . 

F.:.qs 3a and 3b shov.- a pa-per product accoi-d.ing iv.o the 
in-v-ention. Fig, 3a sliows a sheet of paper 30 where a part 
31 of the sirrrace o.t tb.e back. of. the sheet is coated with 
a weakly adhesive layer. The adhesion 0:f the layer is 
snfticienr for the sheet 30 to be ab]e to be attached to 
a flat -v-exzical surface without falling off due .to ics 
own weight. At the same time, the adhesion is sufficient- 
ly weak tor the sheet 30 to be able to be removed easily 
f.rou! the surface. Snch adhesive material is well-known 
and it need m pace for notes which are sold, for exaiv;- 
ple, under the tradename POST -IT. The front of the sheet 
coiTiprises a writing surface 32, This is covered with a 
posit ion- coding pattern 3 3 as described abc^ve. A number 
of acti-cation icons .34,. 35, 36 are printed on the writ- 
ing surface, operating ae described above. The activation 
ico.cs can preferably be designed as boxee to .be marked 
with a croes. 

paper prcduct such as that described in connect ion 
wit;:! ^^i-?T- 3a is preferably ma,nuf actured and sold in pads 
as Bb.ovin. in Fig, 3b. Here a large n-a;TU-jer of essentially 
identical sheets of the type described above are termed 



into a pad by means of. ciie v/eakiy adhesi^-e layer whicr: 1.3 
depoeited or.i the back of each s.iser- . Hov/ever,. the bottom 
sheet in each pad is preferably free of adhesive iiiate- 
ri.al , The paper product caii be used a similar way tO' 
the notepad (Fig. i) described above . 

Fig, 4a ivhows the opera tiori of a coraputer prog.rair:,. 
.stored on a storage -riediurfi, according to the invent ioo . 
This comp-Citer progr£i.ra works preferably together v,?ith the 
paper pzoduou described above. In snch a case a oonipui. er 
prograES^ is provided for a computer system 40 ^ vjhich pro- 
oran^ is 3rra:igei -co detect both graphical ir:puts 4.1 car- 
ried out on a writing surface 42 covered with a positd,on 
code, and activation icons 43 located on this writing 
suvface 42. A graphical input i~ essentially the ^^rae v^s 
a digital representation of handwritten ini oriTsation . 

The use of the compucer program is as follows: A 
user Vv'riren; a graphical input 4i on the vrriiring sur.tace 
4 2 uaing a nib on a reading pen 44 v/hich can detect the 
potvition code on the writing sur.£aoe 42. Ac the eavae ti;rie 
the graphical input 41 is sent in digital formj prefer- 
ably as a polygon train representing the positions which 
Lhe reading pen 44 detects v/hen the graphical inpuc 41 is 
written on che writing surf ace 42 , to the computer systeEi 
4 0 by 'neans.. for exanple, of a shore -range radio link. 
The user then marks a certain activation icon 45 in order 
to indicate ohat the graphical inpui.-. is to be associa'ced 
\vith a cercai.;! application in the co-riputer sysceir, 40, The 
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posit ion- coding pattexT- where the selecced a civ.-, vac. .■•.on 
icon 4 is iocaced can also be deuected by the reading p&n 
4-;, for which reason inroririat .i O:) coTrespondinci to these 
positions is also sent to the oemputer system 40. The 
cornpuv.er syster;-; 40 can thus' determine wh.ich activav..i.on 
icor. the user has selected and :.hereiore v.'hnch applica- 
tion the user wants to associate with the graphical 
input 41,. The computer system 4 0 rs arranaed to reproduce 
thereafte.r cb.e gr;5p;-ical input in a window 46 belo.nQ- 

ing to the applioation concerned or associated with this, 
for exanipXe adjoining it. The computer system 40 may also 
be integrated into the reading pen 44, 

The user can configure che cotnputer program himBelf 
in several ways. For exa;npls, .by means ol; .settings in v.he 
program the user can link a certain act.i.vair.ion icon or 
box on a base with a certain application m a coniputer 
systet^. The user can. also allow more operations than the 
r--productlon operation to be carried out. For exaniple, a 
nxvssage can be sent to another user sx tl:e same time as 
being displayed in a windov^ in an appliGation in the com- 
puter system. :t is also possible to lln.k an activation 
icon v;ith a number of a-ppiications in a computer system 
or With applications in several computer systems. The 
p.roaram can be varieo and utilized in a nurrJ-jer of ways in 
a similar way to that described in connection with Fig, 1 
and Fig. 2, 
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Fig. ^'ib shov/s « flov.? chart illustrating seeps corre- 
sponding --.o instructions in such a prograrn. In. a first- 
step 48 the conputer systeva detecti^ a ceri:.ain acv-ivatron 
icon on a product-. In a second step 49 a graphical input 
is dav.ected. The r.-equence of the first and seocod steps 
is determined by the order in whioh the user carries out 
the selection of the activacion icon and the carrying out 
of the graphical input. In a third step 50 the computer 
syffte;r; reproduces the graphical input \vhich:. detected 
in the second step 49 in a program window associated \^ith 
or belonqrr;a to an application associated with the act.-- 
vation icon which was recorded during the first step 4S, 
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What I claif'i arid desire to secure by Letters Patexit 

is : 

1. A product-, ruivin;? at least cne '.-rricirig suriace ',3) 
which ia provided with a position code (5) , which codas 

a number of posit iox:!S on the writing surface to enable 
eleecronic recording- of information which is written on 
the writing surface, by neans of a dev-ice v;hich detects 
the posit. ion code, c h a r a c e r i z e d m that rh« 
product aiso has at least one activation icon il) which, 
when detected by the device, causes the device to ini- 
t.iaue a predeteriri;. ned creracion which v;tlli:v.es id-je infor- 
mation recorded by the device, 

2. A product according to claim 1, wherein the pro- 
duct coftprises a number of activation icons !7a-g) for 
activating various predetermined operations. 

3. A product according to claim 1 o:r 2, wherein the 
icon and the position code are optically cetectafcle. 

4. .4 product according to any one of the preoeding 
cxaima, wherein the predetermined cperation is an opera- 
uicn from the group: dialing a telephone nnn-ber -which io 
part of the information,, sending a fax with text which is 
part of the inforraation, sei-xdi-nq an electronic iTiessage 
with text which is part of the information, writing an 
address which is part of the information in an electronic 
address book, entering calendar information which is part 
of the mf orniatio.n i.a an electrcnic calendar, and emer- 
ing a task in an electronic list. 
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5. A prcdaciv according to any one of: t;-e preceding 
clain-iT, vhere.ir; tl;e poisition code cor,prises a nun^oer of 
synibois ^6) and >;hi;;rein eacn syiv;faoi concr.ihni-.e3 uo r.iie 
coding of isiore than one posii:ioTi. 

6. A product according to -sny one of che preceding 
clairiS; vdnich product: is a nocepad with a number of v;r ic- 
ing si; r faces. 

7 . A paper product consisting of at least one sheet 
(3 0) , at least part of a surface of the sheet being coat- 
ed with a preferably •.veakly adhescve layer (31; and the 
sheet il-0; cooprising a writing surface (32),. o h a r - 

a c t e r i K e d in that the writing surface (32; is 
crovided -/.rich a posit. ion code ;33) v/hich ccdej.' a number 
of petitions on the writing surface [32) to fc.aabie elec- 
tronic record.:. ng of rnf orrsiav: ion (4 1) whicii it- written 
on the writing surface (32) by means of a device which 
detects the position code (33) , the paper product also 
coTTjprising at least one activation icon (34) which, wiien 
it is detected by the device, cau.ses the device t.-.o ini ■ 
tiate a predetermined operation which utilises the i.nfor- 
maticn (41) recorded by the device. 

B, A paper product according to claim 7, vvhare-.n Ld^ie 
^vritisiQ surface a,nd the adhesive layer are o.n oppo.site 
sides of the sheet. 

. A paper product accord i.ng to claim 8, 'vVfierein 
the produci comprises a nuinber of essentially identical 



10. A device for processing information, which 
device is arranged to record and process .■i.vrPor:iiav,.-.on 
e lectronicaiiy, c h a r a c t e. r: i z e d in r.hat the 
device i.^t also arranged to initiiite a prsdeferrriined ope- 
ration, v/nich utilizes che electronically recorded infer- 
tTsatioxi^ when it detects a predeterrained activation icon 
(7a--q; . 

11. A device according to claim 10, wherein the 

d e v i c e i s a r r a ng e d t c .re c o r d i n f r r-;a t i o r: e 1 e c t r o r'i i c a 1 1 y 
by detecting a position code which is located on a writ- 
ing surface upon vdrich tt^e inf C7:n'Lat ion i;u xvxictcen by 
h^snd , 

12. A device according to claim 10 or 11, wherein 
the device coraprises an optical sensor, which is arrang- 
ed to detect the activation icon. 

i:<. A device according to claira 11 or 12, wherein 
Che device comprises an optical sensor, which is arrang- 
ed to record inages of the writing surface, and a signal 
processor which is arranged to utilize the position code 
in cne in-^ages to create a digital representation of the 
information, the digital representation of the infortsa- 
tion heing used in the predetsr-Tiined operation. 

14. A device according to claiiTi 13, ^/iierein the sig- 
nal processor coraprisea a character interpretation func- 
tion which is arranged to convert the recorded informa- 
Lion to character-coded format, so thai:- the digital 
representation of the information is at leaet partially 
in character - coded format , 
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15, A device according to any one of claims 1-0-14 , 
further comprising a mcb.i.ie iielephone r irsinsce iver for 
tr-^nirivexring the recc-rded inf orn^ac ion fron"; the device zo 
an external unit, ".he predetermined Gpsr-\K.ior fc'u'ing an 
cp«rat'.lon tro:a the group: dialing a telephorie numoer 
which is part, of the information, sending a fax with text 
vd-iich iL^ part ot T.be inf onrist ion and sending an electro- 
j-jic "iessage with tent which is part; of the inf orsnation. 

16. A dev'dce accordin;:; to any one of: claims lG-15, 
wherein the device conprises at least one conputer nro- 
graT;i of the addre^nv book, calendar or "to-do'^ list type,, 
the predetermined operation consisting of entering infer- 
mat ion i^Jhich is part of the recorded information into a 
register for use in one of said compnter programs. 

!?■ h device according to any one of claims 10 --15, 
which device is haBd-held. 

18, A device according to any one of claims 10--17, 
fnrcher comprising a pen point for %?riting the informa- 
tion on the vrriting surface . 

19, A con^p-uter program for processing information 
which, is stored in a memory medium which can be read by a 
compnter and which comprises instructions for causing the 
computer to detect an activation icon in an i.-nage and to 
initiate a predetermined operation in response to the 
detection of che activation icon. 

2-0. .4 storage medium for digital inf ormiation, which 
c.3n he read by a computer system and which contains a 

(continued) 
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(continued claim 20} 

corTC-!-;ter prc^raPA for prcc-3ssin;:; inf Grtrsat". ion, c h a r -- 
a c t e r i z e d ir: Lliai. L..bie conputer program coraprises:, 
in any order, instruetlons for the following steps t 

~ detection (48) of an activation xcoii: on a posi- 
t i on ■■ coded S:hee c 

detect ion (4 9) of a graphicai input on said sheet, 
and also the step 

■■ reproduction ^50} of said graphical input in a 
program windov; associated with an application in said 
computer syyte;yi, v/hich application is asc-ociated -.vicn 
said acwivacion icon. 

21. A system for processing information, comprising 
a product which is provided with at least one activation 
icon indicating a predecerrained operation., and a device 
which is arranged to record information electronically 
and "A-hich is arranged i-.o iniL.i.ar.e che predetermined ope- 
ration with respect to rJ^e recorded information when it 
detects ti^je activation icon on the product, 

22. A ayaten according to claim 21, also compriaing 
5 writing surface vvhich is pro^'-ided \vith a pcsition code 
which codes a nun:.ber of positions on the vvriting surface, 
the device being arranged to record the information elec- 
cronicaiiv by detecting the posir.ion code on the v.-riting 
surface . 

23. A method of recording and processing inforn-ia- 
tiorn comprising the steps of writing the inf ormaoion 

(continued} 
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(continued claim 23) 

g;o a v^ricing surface Vv'ith a pen; recording the wriuteri 
information electronically by means of a device, 
c h a r a c t e r i z e d by the si:.ep of c arising the 
device to carry out a predeterniinect opera u. ion vvith. 
respect "co the recorded inicojrratlon by causlnq the 
device tc detect sn accivaticn icon. 

24. A hand-held electronic device whrch is arranged 
to carry out predecerrained operations on command from a 
user, c h a r a c e r i z e d by an optical censor for 
detecting at lease one activation icon, and a signal r/ro- 
cesser which is arranged tc- carry ^^ut one of sai.d pre- 
determined operations when the optical sensor detects the 
activation icon. 
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Absi-.racv. of the D^sc.lo^3ure 



A syscem for processing information consists of a 
product, for example a notepad, which has a writing sur- 
face (3) With a po8it.ior: cede (5), which codes a na-ij-jer 
of DOS ions cn the surface, and a device which is 
arranoed v.o record the mfcrraisticn which is written on 
the writing surface Dy detecting the position code. On 
the. product there are also a number of activation icons 
(7a-gi , Ifeen such an actiTation icon is detected by the 
device, the deviqe iniciaces a predetermined operation 
wnich uciii::es tha r-scordei inf oriT'al-.ion , Such an opera- 
tion can,, for a-'xarnple, consisr. cf dialing a telephone 
number v;hich ic part of the recorded inf orn-iaLien . 

.;i product, a device and a coraputer prograni for pro- 
cessing information are also shown. In addition, a paper 
product a,-:!d a digir.a.l storage rnediumi containing a conv- 
pnter prcgrao are shown. 



F-"^iqure ior publication Figure 2 
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Detect Activation Icon 



...49 



Detect Graphical Input 



Fig, 4b 



Reproduce Graphical Input 



